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Overview 


U.S.  AIRFORCE 


n  Introduction 
n  Software  Metrics 
n  Software  Maturity  Matrix  (SwMM) 
n  SwMM  Relationship  to  CMM-based  Improvement 
n  Summary  &  Conclusion 
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Introduction 


U.S.  AIRFORCE 


n  Background 
n  Vision 
n  Status 


As  of: 
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Background 


U.S.  AIRFORCE 


n  Portfolio  of  the  PEO  for  Command  and  Control  & 
Combat  Support  contains  the  greatest  concentration 
of  software  intensive  programs  of  any  PEO  portfolio. 

n  Software  development  issues  are  among  the  most 
critical  in  the  AFPEO/C2&CS  portfolio. 

n  Software  metrics  now  reported  to  PEO  as  part  of 
periodic  execution  plan  reviews. 


As  of: 
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Vision 


U.S.  AIRFORCE 


n  Identify  incipient  software  problems  and  mitigate 
them  early. 

n  Franchise  the  AFPEO/C2&CS  processes  and 
procedures  to  other  organizations. 


As  of: 
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Status 


U.S.  AIRFORCE 


n  Metrics  are  in  third  spiral  of  development. 

n  Software  Maturity  Matrix  started  early  and  will  end 
last. 

n  Introduction  of  statistical  controls  is  months  away. 


As  of: 
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Software  Metrics 


U.S.  AIRFORCE 


n  Why  Measure? 
n  Measurement  Principles 
n  AFPEO/C2&CS  Reportable  Software  Metrics 


As  of: 
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Why  Metrics? 


U.S.  AIRFORCE 


Objective  measurements  are  the  key  to  objective 
communication. 


As  of: 
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Measurement  Principles 


U.S.  AIRFORCE 


n  Focus  on  a  Key  Few 
n  Keep  Them  Simple 
n  Insure  Reliability  and  Repeatability 
n  Measurements  are  for  Managing 
n  Use  Them! 

n  Unused  measurements  have  the  same  value  as  last 
night’s  unused  hotel  room  or  an  empty  airline  seat. 

n  Be  Prepared  to  Change  or  Modify  Them 


As  of: 
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US.  AIRFORCE 


Software  Metrics  for  AFPEO 

C2&CS 


n  Size  Growth 

n  Workforce  Size  and  Qualifications 
n  Requirements  Fulfillment  (Software  Maturity  Matrix) 
n  Quality  Trends 

n  Selected  Earned  Value  Information 
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Why  Requirements  Fulfillment? 


U.S.  AIRFORCE 


n  Meeting  Requirements  Is  How  We  Will  Be  Measured 

n  Controlling  Requirements  Is  the  First  Step  to  Cost 
and  Schedule  Control 

n  Mutual  Understanding  of  Requirements  Is  the 
Foundation  of  a  Successful  Integrated  Product 
Development  Team 
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Software  Maturity  Matrix 

(SwMM) 


US.  AIRFORCE 


n  Purpose 
n  Description 
n  Evolution 
n  Implementation 


As  of: 
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SwMM  Purpose 


U.S.  AIRFORCE 


n  Forces  Developer  Requirements  Capture  (User, 
Derived,  &  External) 

n  Forces  Developer  Analysis  of  Maturation  Over  Time 
n  Identifies  Areas  of  Non/Under/Over  Performance 
n  Basis  of  Objective  Discussion  of  Status 
n  Flags  Areas  Needing  Management  Attention 


As  of: 
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What  is  an  SwMM? 


US.  AIRFORCE 


n  Format 

n  Expected  Values  Over  Time 
n  Actual  Values  at  Selected  Milestones 
n  At  Least  Four  Milestones  per  Year 
n  Application  and  Tailoring 
n  Evolution 


As  of: 
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SwMM  Format 


U.S.  AIRFORCE 


MS  1 

MS  2 

MS  3 

MS  n 

RQT  1 

RQT  2 

RQT  3 

RQT  n 

As  of: 
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U-S.  AIRFORCE 


SwMM  Initial  Entries:  Expected 

Values 


MS  1 

MS  2 

MS  3 

MS  n 

RQT  1 

/ms  1 
r  1  EV 

/ms  2 
r  1  EV 

/ms  n 
r  1  EV 

RQT  2 

RQT  3 

/ms  3 
r3  EV 

RQT  n 

/ms  1 
rn  EV 

/ms  n 
rn  EV 

As  of: 
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SwMM  MS  Entries:  Actual 

Values 


U.S.  AIRFORCE 


MS  1 

MS  2 

MS  3 

MS  n 

RQT  1 

AVI/ 
EV  1 

AV  n/ 

EV  n 

RQT  2 

RQT  3 

AV  3/ 

EV  3 

RQT  n 

AV  n/ 

EV  n 

As  of: 
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SwMM  Analysis 


U.S.  AIRFORCE 


MS  1 

MS  2 

MS  3 

MS  n 

RQT  1 

RQT  2 

Spare 

Mem. 

200% 

1200% 

180% 

/1 75% 

130% 

/1 50% 

/1 25% 

/1 00% 

RQT  n 

As  of: 
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SwMM  Evolution 


U.S.  AIRFORCE 


MS  1 

MS  2 

MS  3 

MS  n 

RQT  1 

RQT  2 

Spare 

200% 

180% 

130% 

Mem. 

/200± 

/175± 

/150± 

/125± 

/1 00% 

50% 

30% 

25% 

10% 

RQT  n 

As  of: 
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SwMM  Implementation 


U.S.  AIRFORCE 


This  example  is  at  an  early  stage  of  development. 


As  of: 
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GCSS-AF  Software  Maturity 

Matrix  -  CINC  57J1) 


n  Strategic  Cargo  and  Personnel  Movement 
n  Intratheater  Cargo  and  Personnel  Movement 
n  Equipment  and  Supplies  Asset  Visibility 
n  Personnel  and  Equipment  Deployment  Visibility 
n  Prepositioned  Equipment  and  Material  Availability 
n  Location  and  Status  of  Class  IX:  Repair  Parts 
n  Location  and  Status  of  Class  VII:  Major  End  Items 
n  Location  and  Contents  of  Prepositioned  Stocks  and 
Supplies 

n  Location  of  LOCs  and  PODs 
n  Projected  Arrival  of  Forces,  Supplies,  and 
Equipment 

n  Location  and  Status  of  Class  V:  Ammunition 
n  Decision  Tools  and  Logistics  Estimate  Capability 
n  Inter-  and  Intra-theater  forces,  equipment,  and 
supplies  movement 
n  Prepositioned  WRM 
n  Notional  TPFDD 
n  LOC/POE  information 

n  Logistics  Analysis  for  an  Operational  Mission 
n  Transportation  Asset  Location  and  Availability 
n  Transportation  Infrastructure  Information 
n  Munitions  Requirements  by  Phase 


n  LSA  of  COA 

n  Timely,  near  real  time,  accurate  information 
n  Location  and  Status  of  Class  III:  POL 
n  LSA  for  Each  Supply  Class  by  Mission  Phase 
n  Transportation  Asset  Availability  and  Node  Throughput 
Capability 

n  Status  and  Location  of  POL 
n  POL  Requirements  by  Mission  Phase 
n  Unit  and  Personnel  Location  and  Status  Tracking 
n  Logistics  units,  stockage  locations,  LOC 
n  Logistics  units  status  in  AOR 
n  Project  lift  and  transportation  requirements 
n  Compare  time-phased  requirements  vs  available 
resources 

n  Predict  POD  and  POE  requirements 
n  Conduct  operational  mission  logistics  analysis 

n  Assess  transportation  infrastructure  shortfalls 
n  Reliable  and  current  secure  communications 
n  Status  of  laterally  distributed  logistics  assets 
n  Determine  POL  movement  and  theater  capabilities 
n  Simplify  JOPES  TPFDD  process 
n  Project  POL  consumption  with  usage 
n  Project  Munitions  consumption  with  usage 
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U.S.  AIRFORCE 


GCSS-AF  Software  Maturity 

Matrix  -  CINC  57  (2) 


Project  class  of  supply  consumption  from  historical 
data 

Project  Medical  supplies  consumption  with  usage 
Provide  theater  combat  and  civil  engineering  status 

Project  support  requirements  for  incoming 
personnel  and  forces 

Project  water  and  subsistence  consumption  with 
usage 

Plan,  manage  and  track  retrograde  cargo 

Conduct  real-time  medical  supportability  analysis  of 

aCOA 

Provide  battle  space  picture 
Project  POL  consumption  with  usage 


Provide  engineering  supportability  analysis  of  a 
COA 

Provide  ground  LOC  analysis 
Conduct  real-time  medical  supportability 
analysis  of  a  COA 

Compare  medical  support  requirements  with 
available  resources 

Project  Individual  Equipment  consumption  with 
usage 

Project  construction  material  consumption  with 
usage 

Track  NEO  and  humanitarian  requirements  with 
lift  requirements 


As  of: 
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US.  AIRFORCE 


GCSS-AF  Software  Maturity 

Matrix-FY03 


Dec-02  Jan-03  Mar-03  May-03  Jun-03  Jul-03  Sep-03 

Integration  Framework/Air  Force  Portal 
Capabilities 

Applications  on  IF 

15  (goal),  10 
(threshold) 

Single  Sign-on  Applications 

60  (goal),  30 
(threshold) 

Operate  IF  at  more  than  one  site 

Engineering 
approach  delivered 

2nd  NIPRNet  site 
operational 

Deploy  IF  releases 

Version  5  fielded 

Develop  Deployed  Operations  support  approach 

Deployed  CS 
approach  defined 

Implement  .com  access 

.com  access  for 

current  users 

Document  Management 

AFP  document 
management  fielded 

Verity  Search  Implementation 

Verity  search  engine 
fielded  on  AFP 

Warfighter  innovations 

TBD  by  user 

Integration  Framework/Air  Force  Portal 
Characteristics 

Availability 

NIPRNet-99% 

NIPRNet-99.99% 

Enterprise  Data  Warehouse  Spirals 

Capability/Data  Acquisition  -  Maintenance 

Spiral  1  complete 

Spirals  2-5  complete 

Capability/Data  Acquisition  -  Supply 

Wholesale  and 
Deport  Supply 

Requirements 

Forecasting 

Base  Supply,  DLA 

Analysis  &  Capability/Data  Acq  -  Finance 

Plan  complete 

Data  acquisition 
complete 

Analysis  &  Capability/Data  Acq  -  Contracting 

Plan  complete 

Data  acquisition 
complete 

As  of: 
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US.  AIRFORCE 


GCSS-AF  Software  Maturity 

Matrix-FY04 


Dec-03  Mar-04  Jun-04  Sep-04 

Integration  Framework/Air  Force  Portal 
Capabilities 

Applications  on  IF 

45 

Single  Sign-on  Applications 

100 

Operate  IF  at  more  than  one  site 

2  SIPRNet  sites 
operational 

3rd  NIPRNet  site 
operational 

Deploy  IF  releases 

Version  6  fielded 

Develop  Deployed  Operations  support  approach 

Implement  .com  access 

Document  Management 

Verity  Search  Implementation 

Warfighter  innovations 

Integration  Framework/Air  Force  Portal 
Characteristics 

Availability 

SIPRNet-99.99% 

NIPRNet-99.99% 

As  of: 


Integrity  -  Service  -  Excellence 


24 


US.  AIRFORCE 


GCSS-AF  Software  Maturity 

Matrix-FY05 


Dec-04  Mar-05  Jun-05  Sep-05 

Integration  Framework/Air  Force  Portal 
Capabilities 

Applications  on  IF 

100 

Single  Sign-on  Applications 

200 

Operate  IF  at  more  than  one  site 

Deploy  IF  releases 

Version  7  fielded 

Develop  Deployed  Operations  support  approach 

Implement  .com  access 

Document  Management 

Verity  Search  Implementation 

Warfighter  innovations 

As  of: 
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US.  AIRFORCE 


SwMM  Relationship  to  CMM-based  Improvement 


As  of: 
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Areas  Addressed  by  the  SwMM 

at  ML2-Repeatable 


U.S.  AIRFORCE 


n  Requirements  must  be  defined  and  agreed  to. 

n  Project  plans  must  incorporate  appropriate 
milestones  and  estimates. 

n  Project  tracking  is  built  in  at  milestones. 

n  Measurement  is  implicit. 

n  Verification  is  implicit. 

n  Requirements  changes  must  be  controlled  and 
mapped  into  updates,  and  an  audit  trail  must  be 
maintained. 

n  If  outside  suppliers  are  involved,  their  efforts  should 
be  tracked  in  the  same  way. 

n  Conformance  to  requirements  is  implicit. 


As  of: 
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US.  AIRFORCE 


Areas  Addressed  by  the 
SwMM  at  ML  3  -  Defined 


n  The  SwMM  technique  requires  a  process  owner 

n  The  SwMM  Technique  requires  organization  process 
assets  and  data  base 

n  The  organizational  standard  SwMM  technique  must 
be  tailored  for  projects 

n  The  SwMM  can  be  a  focus  for  integrated  product 
teams 

n  Organization  standard  measurements  are  implicit 

n  Organization  standard  verification  is  implicit 

n  Organization  standard  SMM  training  can  be  the 
basis  of  an  organization  training  program 

n  Product  Engineering  efforts  are  focussed  on 
meeting  the  requirements  delineated  in  the  SwMM 


As  of: 
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U-S.  AIRFORCE 


Areas  Addressed  by  the  SwMM  at 
ML  4  -  Quantitatively  Managed 


n  Quantitative  decision  making  is  implicit 

n  Quantitative  product  characteristics  are  implicit 

n  SwMM  data  identifies  areas  for  corrective  action 

n  Satisfaction  of  direct  and  derived  customer 
requirements  is  driven  by  the  SwMM 


As  of: 
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US.  AIRFORCE 


Areas  Addressed  by  the  SwMM  at 

ML  5  -  Optimizing 


n  Continuous  improvement  culture  is  fostered 
by  the  need  to  continuously  improve  the 
“planned”  values  for  the  maturity  profile. 

n  New  technologies  and  processes  can 
change  the  “Planned”  values  in  a  favorable 
way. 


As  of: 
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Summary 


U.S.  AIRFORCE 


n  AFPE0/C2&CS  imposed  software  metrics  set  across 
portfolio. 

n  One  metric,  the  Software  Maturity  Matrix,  tracks 
requirements  satisfaction. 

n  Applying  the  SwMM  is  compatible  with  CMM-based 
improvement  efforts. 


As  of: 
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Conclusion 


U.S.  AIRFORCE 


The  Software  Maturity  Matrix,  in  conjunction  with 
other  metrics  and  as  part  of  periodic  reviews, 
provides  useful  management  insight  into  software 
and  software-intensive  development  programs. 


As  of: 
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